Papers by Seyed Nima Tayarani Bathaie
Generating Vehicular Icon Descriptions and Indications Using Large Vision-Language Models (2024.emnlp-industry)
Copied to clipboard
James Fletcher, Nicholas Dehnen, Seyed Nima Tayarani Bathaie, Aijun An, Heidar Davoudi, Ron DiCarlantonio, Gary Farmaner
| Challenge: | Existing image description systems are trained mainly on natural images, whereas icon images are drawings. |
| Approach: | They propose to use a dataset to generate both visual and functional icon descriptions based on the icon image and its context information in the car manual. |
| Outcome: | The proposed model performs well on the dashboard icon description task while the third model perform poorly. |